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Abstract-In  this  paper  we  present  a  new  algorithm  to  detect 
abrupt  changes  in  a  signal  when  there  is  no  a  priori  knowledge 
of  the  hypotheses  on  the  process  to  be  detected.  This  algorithm  is 
based  on  the  CUSUM  algorithm.  It  can  be  applied  in  case  of 
frequency  and  energy  changes.  This  algorithm  works  when  the 
samples  are  dependant  and  autoregressive  modeling  is  needed. 
It  is  used  to  distinguish  EMG  segments  from  noise  segments. 
Keywords  -  Likelihood  ratio,  CUSUM,  estimation,  AR,  EMG 

I.  Introduction 

Detection  and  segmentation  of  events  in  noisy  random  signals 
are  classical  problems  of  signal  processing.  When  the 
parameters  of  the  hypotheses  are  known,  one  of  the  most 
powerful  algorithms  is  the  CUSUM  algorithm,  which  is  based 
on  the  logarithm  of  likelihood  ratio  [1].  However,  in  most 
applications  (including  biomedical)  the  parameters  of  the 
hypotheses  are  unknown.  Therefore  it  is  necessary  to  propose 
a  new  approach  to  detect  the  changes  in  the  signal  [2]  [3]. 

In  this  paper,  we  present  an  algorithm  for  the 
segmentation  of  signals  without  a  priori  knowledge  of  the 
hypotheses  on  the  process  to  be  detected.  The  new  method 
proposed  in  this  paper  achieves  detection  when  the  signals 
recorded  are  of  long  duration.  This  algorithm  is  based  on  the 
main  idea  of  the  CUSUM  algorithm  (designed  for  known 
hypotheses)  but  adapted  to  be  applied  for  detecting  change 
when  the  parameters  of  the  signals  are  unknown.  In  the  first 
paragraph,  we  present  the  CUSUM  algorithm  idea,  which  is 
based  on  the  logarithm  of  likelihood  ratio  test  between 
hypotheses.  Our  new  algorithm  is  presented  in  the  second 
paragraph  in  case  of  energy  and  frequency  changes.  Finally 
we  will  present  an  application  on  EMG  signals. 

II.  Cusum  Algorithm 

Let  X=  (xi,  x2,  ...,  xt)  be  a  series  of  independent 
observations  up  to  time  t.  Our  problem  is  to  detect  changes  in 
this  sequence.  We  shall  assume  that  the  probability  density 
function  of  the  process  X  depends  on  a  parameter  0.  The 
classical  and  optimal  algorithm  of  this  problem  is  the 
CUSUM  (cumulative  sum)  algorithm  proposed  by  Basseville 
and  Nikiforov  [1].  This  algorithm  consists  of  computing  the 
difference  between  the  value  of  the  log-likelihood  ratio  and 
its  current  minimum  value  at  each  time  t.  The  corresponding 
decision  rule  at  each  time  t,  is  to  compare  this  difference  to  a 
threshold  h. 


The  cumulative  sum  function  is: 

cst=i>;. 

i= 1 

The  detection  function  is: 

gt  =  CSt  -  min  CSk 

1  <k<t 

And  finally  the  stopping  time  is: 

ta  =  inf{  t  >  1  :  g  t  >  h} 


(2) 


(3) 


(4) 


The  detectability  of  this  algorithm  is  based  on  the 
sign  E  (st)  . 

We  can  demonstrate  that: 

Ee0  G<)  <  0 

E9i  (s,  )  >  0 

The  concept  of  the  CUSUM  algorithm  is  illustrated  in  Fig.  1. 


(5) 


III.  The  New  Algorithm 


A.  Introduction 


When  the  parameters  of  the  two  hypotheses  are  unknown 
we  cannot  use  the  CUSUM  algorithm  directly  (0O  and  0i  are 
unknown).  Our  new  algorithm  is  based  on  two  adaptive 
sliding  windows  W0  and  Wi  used  to  estimate  0O  and  0i  at 
each  time  t. 


Signal  0 


200  400  600  800  1000  1200  1400  1600  1800  2000 


E(s)<0 


(b) 


200  400  600  800  1000  1200  1400  1600  1800  2000 


200  400  600  800  1000  1200  1400  1600  1800  2000 


Fig.  1 .  Illustration  of  the  CUSUM  algorithm,  (a)  A  signal  which  changes  at 
time  tM;  (b)  Evolution  of  CS;  and  (c)  Evolution  of  the  decision  function  gt. 


If  f6t  and  U  are  the  probability  density  functions  of  two  These  windows  are  chosen  as  demonstrated  in  Fig.  2. 

hypotheses  H0  and  H1?  the  log-likelihood  ratio  is: 

r  /«,(*») 
sf  =  Ln - 

/«„(*< ) 


(i) 
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X  t  is  not  used  to  estimate  6  o  and  6 1 , which  are  used  to 
compute  st . 

The  adaptive  log-likelihood  ratio  in  this  case  is: 

di 


st  =Ln- 


/'  (V) 

e» 


(7) 


The  adaptive  CUSUM  is: 


ACSt  =5> 

i= 1 


(8) 


Fig.  3.  Flowchart  of  the  new  approach 


In  this  case: 

A  /'  (Xt) 

E(st)  =  E(  ln-^— )<0 

/  (*,) 


(11) 


b)-  If  a  change  occurs  in  the  signal  6  o  is  an  estimation  of 


The  new  decision  function  is: 

gt=  ACS,  -  min  ACSk  (9) 

1  <k<t 

The  new  idea  in  our  algorithm  is  to  use  two  threshold 
values  ^  and  h.  fy  is  used  to  stop  the  estimation  of  0O  when  Ef 
begins. 

The  flowchart  of  our  algorithm  is  presented  in  Fig.  3. 

B.  Detectability  of  the  New  Algorithm 


0O  and  6\  is  an  estimation  of  0L 
In  this  case: 

/*  (*,) 

E(st)  =  EQ*-f—)>0  (12) 

/*  (xt) 

C 

We  note  that  the  new  algorithm  conserves  the  property  of 
the  detectability  of  CUSUM  algorithm. 


It  can  be  shown  in  our  new  algorithm  that: 

Ee0(st)  <  0 

Eet  (st )  >  0 


(10) 


As  in  case  of  the  CUSUM  algorithm,  this  property  is  very 
important  to  verify  whether  the  new  approach  can  detect 
changes  or  not.  There  are  two  considerations  needed  to  verify 
this  point: 


a)-  If  no  change  occurs  in  the  signal,  when  t  tends  towards 


IV.  Detection  of  Energy  Changes 


In  the  case  of  energy  changes,  we  assume  that  the  samples 
are  independent  and  that: 


/«„(*») 


2<7n 


(13) 


feMt) 


(14) 


infinity  Qo  is  close  to  0O,  and  6\  is  an  estimation  of  0O. 


3  of  4 


The  log-likelihood  ratio  of  st  can  then  be  expressed  as: 


1  <7o  ,  2x  1  lx  ,,  ^ 

St  =-ln  —  +  xt  - — )  (15) 

of  2cr0  2a\ 


A  2  A  2 

do  and  (Ji  are  estimated  using  W0  and  Wi. 

V.  Detection  of  Frequency  Changes 


In  biomedical  applications,  the  changes  can  affect  signal 
energy  and  frequency.  In  this  case  the  CUSUM  algorithm  can 
not  be  used  because  the  samples  of  the  signal  are  dependent, 
therefore  AR  modeling  is  needed.  The  probability  density 
function  of  the  signal  for  AR  modeling  is: 


fe  (V* i’X2 


xi- i) 


(16) 


The  adaptive  CUSUM  is: 


ACSt  =5> 

i= 1 


The  decision  function  is: 

gt  =  ACSt  -  min  ACSk 


(19) 


(20) 


The  value  of  st  can  be  expressed  as: 

1  ,—.2  ><0x2  /  1\2 

st=- ln^  +  ^-L-^L 

2  of  2  (Jq  2a2 


(21) 


By  applying  this  formula  we  can  detect  both  energy  and 
frequency  changes. 


VI.  Results 

A-  Results  on  Simulated  Signals 


p 

Where  et  , (et)  is  a  Gaussian  white  noise 

i= 0 

sequence  with  variance  a  2  . 

To  apply  our  algorithm  for  AR  modeling,  three  windows 
are  needed: 


^0 

:  1  .  t  —  p  —  1  — ^  0  q 

<  W1  : 

t  +  1 .  t  +  N  — ^  0  i 

(17) 

W 

p 

I 

i 

Co  > 

These  windows  are  interpreted  in  Fig.  4. 

In  case  of  AR  modeling,  Oo  =  (a®  ,...,a°p,OQ )  and 

0i  =((*;,. of). 

The  log-likelihood  ratio  is: 

a  /--  (X,  I Xt_x,Xt_2,....,Xt_p) 

st=LnPP— - -  (18) 


Detection  algorithms  were  first  applied  on  simulated 
signals  in  order  to  study  the  performance  of  the  algorithm. 
For  that  purpose,  signal  segments  were  generated  using 
Gaussian  white  noise  filtered  by  a  bandpass  filter  at  different 
central  frequencies  and  identical  bandwidth  BP.  Each  Hj 
corresponded  to  a  bandpass  filtered  signal  with  a  central 
frequency  fj. 

As  shown  in  Fig.  5.,  the  method  can  detect  different  segments 
in  a  simulated  signal. 

B-  Results  on  EMG  Signals 

An  EMG  signal  contains  information  about  muscular 
activity.  The  characteristics  of  the  signal  depend  on  the 
physiological  conditions  and  the  recording  environment.  To 
process  an  EMG  signal,  it  is  necessary  to  identify  the  parts  of 
a  signal  when  the  muscle  is  active.  The  muscle  is  active  in  the 
4th  segment  of  Fig.  5.  Our  aim  is  to  detect  these  segments  and 
to  separate  all  EMG  activity. 

The  detection  of  the  segments  in  the  EMG  signals  are 
shown  in  Fig.  6. 


x104 

Fig.  5.  Detection  result  on  a  simulated  signal. 


Fig.  4.  Definition  of  windows  in  the  case  of  AR  modeling. 
W0 :  used  to  estimate  0O,  Wi  :  used  to  estimate  0i 
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Fig.  6.  Detection  of  segments  in  an  EMG  signal: 

(a)  A  signal  that  contains  two  segments  Segi  and  Seg2; 

(b)  The  spectral  density  of  Segi;  and  (c)  The  spectral  density  of  Seg2 

VII.  Conclusion  and  Persepective 


In  this  paper  we  presented  a  sequential  segmentation 
algorithm  method  applied  without  a  priori  knowledge  on  the 
parameters  of  the  hypotheses  to  be  detected. 

Our  new  algorithm  is  based  on  the  log-likelihood  ratio 
between  two  instantaneous  hypotheses  estimated  at  each  time 
t.  It  is  used  when  the  changes  affect  the  energy  and  the 


frequency  of  the  signal.  When  applied  on  simulated  signals  it 
produced  a  satisfactory  segmentation. 

This  algorithm  has  to  be  augmented  with  additional 
processing  in  order  to  classify  EMG  signals  and  to  identify 
the  corresponding  physiological  events. 
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